Universal Behavior of Load Distribution in Scale-free Networks 
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We study a problem of data packet transport in scale-free networks whose degree distribution 
follows a power-law with the exponent 7. Load, or betweenness centrality of a vertex is the accu- 
mulated total number of data packets passing through that vertex when every pair of vertices send 
and receive a data packet along the shortest path connecting the pair. It is found that the load 
distribution follows a power-law with the exponent S w 2.2(1), insensitive to different values of 7 in 
the range, 2 < 7 < 3, and different mean degrees, which is valid for both undirected and directed 
cases. Thus, we conjecture that the load exponent is a universal quantity to characterize scale-free 
networks. 
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PACS numbers: 89.70.+C, 89.75.-k, 05.10.-a 

Complex systems consist of many constituents such as 
individuals, substrates, and companies in social, biolog- 
ical, and economic systems, respectively, showing coop- 
erative phenomena between constituents through diverse 
interactions and adaptations to the pattern they create 
jl],^j. Interactions may be described in terms of graphs, 
consisting of vertices and edges, where vertices (edges) 
represent the constituents (their interactions). This ap- 
proach was initiated by Erdos and Renyi (ER) || . In the 
ER model, the number of vertices is fixed, while edges 
connecting one vertex to another occur randomly with 
certain probability. However, the ER model is too ran- 
dom to describe real complex systems. Recently, Watts 
and Strogatz (WS) introduced a small-world network, 
where a fraction of edges on a regular lattice is rewired 
with probability pws to other vertices. More recently, 
Barabasi and Albert (BA) |5|-|7j introduced an evolving 
network where the number of vertices N increases lin- 
early with time rather than fixed, and a newly intro- 
duced vertex is connected to m already existing vertices, 
following the so-called preferential attachment (PA) rule. 
When the number of edges k incident upon a vertex is 
called the degree of the vertex, the PA rule means that 
the probability for the new vertex to connect to an al- 
ready existing vertex is proportional to the degree k of 
the selected vertex. Then the degree distribution Pd(^) 
follows a power-law Prj(fc) ~ k"" 1 with 7 = 3 for the BA 
model, while for the ER and WS models, it follows a Pois- 
son distribution. Networks whose degree distribution fol- 
lows a power-law, called scale- free (SF) networks || , are 
ubiquitous in real-world networks such as the world-wide 
web f|-[ll|], the Internet the citation network Q 

and the author collaboration network of scientific papers 
jig |l8|, and the metabolic networks in biological organ- 
isms IQ. On the other hand, there also exist random 
networks such as the actor network whose degree distri- 
bution follows a power-law but has a sharp cut-off in its 
tail pfj. Thus, it has been proposed that the degree 
distribution can be used to classify a variety of diverse 
real- world networks [po[ . In SF networks, one may won- 
der if the exponent 7 is universal in analogy with the 



theory of critical phenomena; however, the exponent 7 
turns out to be sensitive to the detail of network struc- 
ture. Thus, a universal quantity for SF networks is yet to 
be found. From a theoretical viewpoint, it is important 
to find a universal quantity for SF networks, which is a 
purpose of this Letter. 

A common feature between the WS and SF networks 
would be the small-world property that the mean sep- 
aration between two vertices, averaged over all pairs of 
vertices (called the diameter hereafter), is shorter than 
that of a regular lattice. The small- world property in SF 
networks results from the presence of a few vertices with 
high degree. In particular, the hub, the vertex whose de- 
gree is the largest, plays a dominant role in reducing the 
diameter of the system. Diameters of many complex net- 
works in real world are small, allowing objects transmit- 
ted through the network such as neural spikes on neural 
network, or data packets on Internet, to travel from one 
vertex to another quickly along the shortest path. The 
shortest paths are indeed of relevance to network trans- 
port properties. When a data packet is sent from one 
vertex to another through SF networks such as Internet, 
it is efficient to take a road along the shortest paths be- 
tween the two. Then vertices with higher degrees should 
be heavily loaded and jammed by lots of data packets 
passing along the shortest paths. To prevent such Inter- 
net traffic congestions, and allow data packets to travel 
in a free-flow state, one has to enhance the capacity, the 
rate of data transmission, of each vertex to the extent 
that the capacity of each vertex is large enough to han- 
dle appropriately defined "load" . 

In this Letter, we define and study such a quantity, 
which we simply call load, to characterize the transport 
dynamics in SF networks. In fact, this quantity turns 
out to be equivalent to "betweenness centrality" which 
was introduced in a social network to quantify how much 
power is centralized to people in social networks |]l7| , pT| . 
While it has been noted that the betweenness central- 
ity has a long tail ^2j, here we focus our attention on 
its probability distribution for various SF networks with 
different degree exponents. Thus knowing the distribu- 



tion of such quantity enables us to not only estimate 
the capacity of each vertex needed for a free-free state, 
but also understand the power distribution in social net- 
works, which is another purpose of this Letter. 

To be specific, we suppose that a data packet is sent 
from a vertex i to j, for every ordered pair of vertices 
For a given pair it is transmitted along the 

shortest path between them. If there exist more than one 
shortest paths, the data packet would encounter one or 
more branching points. In this case, we assume that the 
data packet is divided evenly by the number of branches 
at each branching point as it travels. Then we define the 
load £k at a vertex k as the total amount of data packets 
passing through that vertex k when all pairs of vertices 
send and receive one unit of data packet between them. 
Here, we do not take into account the time delay of data 
transfer at each vertex or edge, so that all data are de- 
livered in a unit time, regardless of the distance between 
any two vertices. 

We find numerically that the load distribution Pl(1) 
follows a power-law Pl{1) ~ t ~ S ■ Moreover, the expo- 
nent 6 « 2.2 we obtained is insensitive to the detail of 
the SF network structure as long as the degree exponent 
is in the range, 2 < 7 < 3. The SF networks we used 
do not permit rewiring process, and the number of ver- 
tices are linearly proportional to that of edges. When 
7 > 3, S increases as 7 increases, however. The univer- 
sal behavior is valid for directed networks as well, when 
2 < {7in,7out} < 3. Since the degree exponents in most 
of real-world SF networks satisfy 2 < 7 < 3, the universal 
behavior is interesting. 

We construct a couple of classes of undirected SF net- 
works both in the static and evolving ways. Each class 
of networks include a control parameter, according to 
which the degree exponent is determined. First, we deal 
with the static case. There are N vertices in the system 
from the beginning, which are indexed by an integer i 
(i = 1, . . . , N). We assign the weight pi — i~ a to each 
vertex, where a is a control parameter in [0, 1). Next, we 
select two different vertices with probabilities equal 
to the normalized weights, pi/ ^2 k Pk and pj/ ~^2 k Pk, re- 
spectively, and add an edge between them unless one 
exists already This process is repeated until mN edges 
are made in the system. Then the mean degree is 2m. 
Since edges are connected to a vertex with frequency pro- 
portional to the weight of that vertex, the degree at that 
vertex is given as 

kj _ (1-oQ m 

where J^j kj — 2miV. Then it follows that the degree 
distribution follows the power-law, Po{k) ~ k~~< ', where 
7 is given by 

7 =(1 +a)/a. (2) 

Thus, adjusting the parameter a in [0,1), we can obtain 
various values of the exponent 7 in the range, 2 < 7 < 00. 



Once a SF network is constructed, we select an or- 
dered pair of vertices on the network, and identify 
the shortest path(s) between them and measure the load 
on each vertex along the shortest path using the modified 
version of the breath-first search algorithm introduced by 
Newman jl7| . It is found numerically that the load li at 
vertex i follows the formula, 



with (3 = 0.80(5). This value of (3 is insensitive to dif- 
ferent values of the exponent 7 in the range, 2 < 7 < 3 
as shown in the inset of Fig. 1. The total load, ^2jlj 
scales as ~ iV 2 log N. This is because there are N 2 pairs 
of vertices in the system and the sum of the load con- 
tributed by each pair of vertices is equal to the distance 
between the two vertices, which is proportional to log N. 
Therefore, the load li at a vertex i is given as 

ti ~ {N\ogN)(N/if. (4) 

From Eq.(4), it follows that the load distribution scales 
as P L (l) ~ l~\ with 5 =1 + 1/(3 k, 2.2(1), independent 
of 7 in the range, 2 < 7 < 3. Direct measure of Pl{1) 
also gives S w 2.2(1) as shown in Fig. 1. We also check 
S for different mean degrees m = 2,4 and 6, but obtain 
the same value, S w 2.2(1). Thus, we conclude that the 
exponent S is a generic quantity for this network. Note 
that Eqs.(l) and (4) combined gives a scaling relation 
between the load and the degree for this network as 

*~fc(T-D/(«-i). (5) 

Thus, when and only when 7 = <5, the load at each vertex 
is directly proportional to its degree. Otherwise, it scales 
nonlinearly. On the other hand, for 7 > 3, the exponent 
S depends on the exponent 7 in a way that it increases 
as 7 increases. Eventually, the load distribution decays 
exponentially for 7 = 00 as shown in Fig. 1. Thus, the 
transport properties of the SF networks with 7 > 3 are 
fundamentally different from those with 2 < 7 < 3. This 
is probably due to the fact that for 7 > 3, the second 
moment of Pd{£) exists, while for 7 < 3, it does not. 

We examine the system-size dependent behavior of the 
load at the hub, lh for the static model. According 
to Eq.(4), £h behaves as lh ~ N 8 logiV in the range, 
2 < 7 < 3, while for 7 > 3, lh increases with N but at 
a much slower rate than that for 2 < 7 < 3 as shown 
in Fig. 2. That implies that the shortest pathways be- 
tween two vertices become diversified, and they do not 
necessarily pass through the hub for 7 > 3. That may 
be related to the result that epidemic threshold is null in 
the range 2 < 7 < 3, while it is finite for 7 > 3 in SF 
networks, because there exist many other shortest paths 
not passing through the hub for 7 > 3, so that the infec- 
tion of the hub does not always lead to the infection of 
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the entire system. Thus, epidemic threshold is finite for 
7 > 3 @. 

Next, we generate other SF networks in an evolving 
way, using the methods proposed by Kumar et al. [ p3| , 
and by Dorogovtsev et al. In these cases, we also find 
the same results as in the case of static models. 

We also consider the case of directed SF network. The 
directed SF networks are generated following the static 
rule. In this case, we assign two weights pi = i~ a ° ut 
and qi — i" Qin (i = 1, . . . , TV) to each vertex for outgo- 
ing and incoming edges, respectively. Both control pa- 
rameters a ou t and a- m are in the interval [0, 1). Then 
two different vertices arc selected with probabili- 

ties, Pi/J2kPk and Ij/Hklk, respectively, and an edge 
from the vertex i to j is created with an arrow, i — > j. 
The SF networks generated in this way show the power- 
law in both outgoing and incoming degree distributions 
with the exponents 7 out and 7; n , respectively. They are 
given as 7 out = (1 + a out )/a ou t and 7 in = (1 + a in )/a in . 
Thus, choosing various values of a ut and a m , we can de- 
termine different exponents 7 out and 7; n . Following the 
same steps as for the undirected case, we obtain the load 
distribution on the directed SF networks. The load expo- 
nent S obtained is » 2.3(1) as shown in Fig. 3, consistent 
with the one for the undirected case, also being indepen- 
dent of 7 ou t and 7i n in 2 < {7 ou t,7in} < 3. Therefore, we 
conjecture that the load exponent is a universal value for 
both the undirected and directed cases. 

To see if such universal value of 5 appears in real world 
network, we analyzed the co-authorship network, where 
nodes represent scientists and they are connected if they 
wrote a paper together. The data are collected in the 
field of the neuro-science, published in the period 1991- 
1998 fjs|j . This network is appropriate to test the load, 
i.e., the betweenness centrality distribution, because it 
does not include rewiring process as it evolves, and its 
degree exponent 7 ss 2.2 lies in the range 2 < 7 < 3. As 
shown in Fig. 4, the load distribution follows a power-law 
with the exponent 5 « 2.2, in good agreement with the 
value obtained in the previous models. 

We also check the load distribution for the case when 
data travel with constant speed, so that the time delay 
of data transfer is proportional to the distance between 
two vertices. We find that the time delay effect does not 
change the load distribution and the conclusion of this 
work. The reason of this result is that when the time de- 
lay is accounted, load at each vertex is reduced roughly 
by a factor log N, proportional to the diameter, which is 
negligible compared with the load without the time de- 
lay estimated to be ~ A^ 18 logA r in Eq.(4). Due to this 
small- world property, the universal behavior remains un- 
changed under the time delay of data transmission. 

Finally, we mention the load distribution of the small- 
world network of WS which is not scale-free. It is found 
that its load distribution does not obey a power-law, but 
shows a combined behavior of two Poisson-type decays 
resulting from short-ranged and long-ranged connections, 
respectively, as shown in Fig. 5. We also find the average 



load, I(pws) = (]-/N)J2i£i(Pws), as a function of the 
rewiring probability pws decays rapidly with increasing 
Pws, behaving similar to the diameter in the WS model, 
as shown in the inset of Fig. 5. 

In conclusion, we have considered a problem of data 
packet transport on scale- free networks generated accord- 
ing to preferential attachment rules and introduced a 
physical quantity, load {£i} at each vertex. We found 
that the load distribution follows a power-law, Pl(£) ~ 
£~ 5 , with the exponent S » 2.2(1), which turns out to 
be insensitive to the degree exponent in the range (2,3] 
when rewiring process is not included and the networks 
are of unaccerelated growth. Moreover, it is also the same 
for both directed and undirected cases within our numer- 
ical uncertainties. Therefore, we conjecture that the load 
exponent is a generic quantity to characterize scale-free 
networks. The universal behavior we found may have 
interesting implications to the interplay of SF network 
structure and dynamics. For 7 > 3, however, the load 
exponent S increases as the degree exponent 7 increases, 
and eventually the load distribution decays exponentially 
as 7 — » 00. It would be interesting to examine the ro- 
bustness of the universal behavior of the load distribution 
under some modifications of generating rules for SF net- 
works such as rewiring process and acceleration growth, 
which, however, is beyond the scope of the current study. 
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FIG. 1. Plot of the load distribution Pl(£) versus £ for var- 
ious 7 = 2.2 (o), 2.5 (□), 3.0 (o), 4.0 (x), and oo (A) in 
double logarithmic scales. The linear fit (solid line) has a 
slope —2.2. Data for 7 > 3.0 are shifted vertically for clear- 
ance. Dotted lines are guides to the eye. Simulations are 
performed for N = 10, 000 and m — 2 and all data points are 
log-binned, averaged over 10 configurations. Inset: Plot of 
the normalized load £i/^2 k £k versus vertex index i in double 
logarithmic scales for various 7 = 2.2 (o), 2.5 (□), and 3.0 
(o). 



FIG. 2. Plot of the system-size dependence of the load at 
the hub versus system size N for various 7 = 2.2 (o), 2.5 (□), 
3.0 (O), 4.0 (x), and 00 (A). Solid line is iV^logiV and 
dotted lines have slopes 1.70 and 1.25, respectively, from top 
to bottom. Simulations are performed for m = 2 and all data 
points are averaged over 10 configurations. 
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FIG. 3. Plot of the load distribution Pl (I) versus £ for the 
directed case. The data are obtained for (7i n ,7out) = (2.1, 
2.3) (o), (2.1, 2.7) (+), (2.5, 2.7) (□) and (2.5, 2.2) (x). The 
fitted line has a slope —2.3. All data points are log-binned. 



10° 



1(T 



10- 



10- 







0. . 


P D (k) : 




■e, 

















10° 10 1 10 2 10 3 

ft, £/N 

FIG. 4. Plot of the degree distribution P D {k) (O) and 
the load distribution Pl(£) (°) for a real- world network, the 
co-authorship network. The number of vertices (different au- 
thors) are 205,202. Least square fit (solid line) has a slope 
— 2.2. All data points are log-binned. 
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FIG. 5. Plot of the load distribution Pl{1) versus load I 
for the small-world network. Simulations are performed for 
system size N = 1, 000, and average degree (fc) = 10, and the 
rewiring probability pws = 0.01, averaged over 500 configu- 
rations. Inset: Plot of the average load (o), diameter (+), 
clustering coefficient (□) versus the rewiring probability pws- 
All the data are normalized by the corresponding values at 
Pws = 0. Dotted lines are guides to the eye. 
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